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Abstract — In the era of heavy-duty transmission control 
protocols (TCP), adapted for extremely hi-bandwidth data- 
centers; the fundamental question of stable interaction with 
either proposed/customized active queue management(AQM) or 
popularly discussed Random Early Detection (RED) remains 
a hotly debated issue. While there are claims of "oscillation" 
only dynamical behavior, there are equally large number 
of claims which demonstrate the chaotic nature of different 
flavors of TCP and their AQM interaction. In this work, 
we provide a sound and analytical mathematical model of 
DTCP/D2TCP and study their interaction with threshold based 
packet marking policy. Our work shows that for a simple 
scenario this interaction is chaotic in nature and has large 
variability in dynamical behavior over orders of magnitude 
changes in parameter range as demonstrated by bifurcation 
diagrams. We conclude with numerical simulation evidence that 
chaotic behavior of protocols is inherent in their design which 
they inherit from their early vanilla TCP days, and it has 
serious implications for data-center throughput, load batching 
and collapse in Incast kind of scenario. 

I. Introduction 

In the era of record breaking memory to memory through- 
put, dynamical behavior of Internet protocols has become key 
to achieving predictability, optimal utilization of resources 
and dynamic stability in throughput allocation among partic- 
ipating agents/devices/entities. With the recent proposals of 
DCTCP, D2TCP, CTCP, D3 etc, a new research area of super- 
optimal and dynamically oscillating behavior of transport 
protocols has been forging itself. 

We based our analysis and discrete time models in contrast 
to the early claims of periodic only behavior in DCTCP 
and its different relatives and derivatives. We show again 
that discrete time models are the right framework to think 
about next generation successors of TCP and chaos remains 
a dominant phenomenon in the case of wildly fluctuating 
parameter ranges. In particular, we compare its dynamical 
behavior with switched power electronic circuits and impact 
oscillators. 

II. Objective of the study 
The objectives of our study are as follows: 

1) Build a discrete time mathematical model of DCTCP- 
AQM interaction. 

2) Use techniques from discrete time maps to analyze 
their behavior. 
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3) Simulate and demonstrate chaotic behavior 

III. DCTCP CONGESTION CONTROL ALG0RITHM:AN 
OVERVIEW 

In this section we describe qualitatively the DCTCP 
algorithm[l] with its major algorithmic details so as to lay 
a foundation for our discrete modeling. We also describe 
the fact that D2TCP [2] can be built upon DCTCP through 
certain specific changes and we also argue that D2TCP 
is more general and that DCTCP forms a special case of 
D2TCP 

A. A simple active queue management scheme at the Switch: 

The marking scheme involves the use of only a single 
parameter K. An arriving packet is marked with its CE 
(Congestion Experienced) bit set to 1 iff upon its arrival the 
instantaneous queue size is greater than K. 

B. ECN Echo at receiver 

A difference between conventional TCP receivers and 
DCTCP receiver is in the way the status of the incoming CE 
bits are conveyed back to the sender For the DCTCP receiver 
ACKs (ACK- Acknowledgment Packet) every single incom- 
ing packet and its ECN(External Congestion Notification)- 
Echo flag bit set to 1 when a marked packet (CE=1) is 
received. DCTCP tries to convey the exact sequence of the 
received code points. This is accomplished by sending a 
delayed ACK (1 cumulative ACK for a set of m received 
packets) which contains the sequence of ECN- Echo flag 
based on last m incoming packets. Thus the controller at the 
sender can make out the congestion status in the queue upon 
reception of the delayed ACK. 

C. Controller at the sender 

The sender maintains a running estimate of the fraction 
of packets that are marked. Called a. Which is updated in 
everyRTT (Round Trip Time) as follows: 
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g here is the weight associated to the marked fraction. F 
is the fraction of packets marked and is given by the drop 
probability in the current window. Given the fact that the 
sender receives Marks for every packet sent when the queue 
length is higher than the threshold and does not receive any 
marks when the queue length is below threshold K thus (|9]l 
implies that a estimates the probability that the queue size is 
greater than K. Essentially, a close to implies low levels 
of congestion and when close to 1 implies high levels of 
congestion. 



D. Window size control at the sender : 

The only difference between a DCTCP Sender and a 
TCP Sender is how each react on receiving the ACK with 
ECN flag on. In the slow start phase the Window size 
increases slowly in both the cases to estimate the available 
bandwidth. On receiving congestion notification The TCP 
always controls congestion by halving the window size 
and then slowly increasing additively in the congestion 
avoidance phase. Where as in the DCTCP scheme when it 
senses congestion the window size is modified as: 
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Thus the congestion extent determines the change in the 
window size. It is only slightly reduced at low levels of 
congestion and when congestion levels are high ,say 1 then 
the congestion window is reduced by half as in TCP. This is 
the chief contribution of DCTCP in maintaining a low queue 
length without compromising throughput. 

In DeadUne Aware Data Center TCP (D2TCP) all the 
essential components of DCTCP is kept same but the a 
(congestion history parameter) is modified as : 
a = Where y is the deadline factor A high y implies a 
closer deadline and a low value of y implies far deadline. 
So DCTCP is a special case of D2TCP with y = 1 which 
implies long lived flows with no deadline. 

IV. Conventional RED Controller at Switch 

The RED [3] mechanism is available as an External Con- 
gestion Notification (ECN) mechanism in modem switches. 
This section gives a brief discussion on the RED (Random 
Early Detection) at the switch and the modification that 
needs to be made in order to support the DCTCP queue 
management scheme without the need of extra external 
hardware. We present here a discrete model of the RED 
system and the sampling interval is one RTT. 

The RED module calculates exponentially weighted mov- 
ing average of the queue size at the switch end. 

Let w be the exponential averaging weight and qit_ be the 
instantaneous queue size. On each packet arrival the RED 
algorithm updates its average queue length (^) to: 



*+l = {l-w)-q,^ + wqk+\ 



(3) 



If the average queue length is below a certain advertised 
threshold ^,„,„ then the packet is admitted into the queue for 
subsequent transmission through the link and when it exceeds 
qnuix it is either dropped or marked as per requirement. If it 
lies in the range of qmin and qmax then it is dropped/marked 
with a probabiUty p given by: 



Pk+\ = 
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(4) 



A. Implementation of DCTCP packet marking strategy 
through RED 

To implement DCTCP packet marking strategy through 
RED we need to: 

1) Set qijjjfj qmax ^ 

2) The decision making should be with respect to the 
instantaneous queue size {q^) instead of the average 
queue size. 

Thus implementing the above (|4| becomes 



Pk+i 



(5) 



[0 if qk+i<K 
[I if qk+l>K 

Thus,© gives us the hard control required in the case of 
DCTCP algorithm. 

V. Derivation of a discrete model for a network 

EMPLOYING DCTCP AT THE SENDER END AND MODIFIED 

RED AT THE Switch. 

A. Background 

We model the D2TCP system along with its implicit 
congestion control mechanism at the switch implemented 
through available RED module, as a discrete time map 
obtained by periodically sampling the system state. Since 
window size and queue size behave as step functions of an 
RTT,one RTT is the sampling interval that captures their 
changes. Based on the DCTCP algorithm we propose our 
discrete model that takes window size and congestion history 
as state variables. We develop the expressions for a single 
active connection so as to present the dynamics of the queue 
size and study the effect of the changes of parameter on the 
it. The model can be extended without the loss of generality 
to synchronized connections. 

B. The model 

A complex network employing DCTCP is essentially a 
feedback loop in which the senders adjust their rate by 
observing the rate of packet loss i. e by a feedback from 
the router. Each flow at a router sends packets that are 




Feedback System 



Fig. 1 . Figure showing the feedback mechanism of DCTCP 

queued in the shallow buffeiQ for subsequent transmission 
through the link. The packets are marked following a control 
strategy employed at the router end. DCTCP employs a 

' Shallow Buffer means buffers having low capacity in high speed switches 



bursty marking strategy at the router following (|5)- When 
the sender notices the packets are being marked it adjusts its 
sending rate accordinglyjn the case of DCTCP the window 
size is reduced following a congestion history parameter 
a. The logical structure of DCTCP congestion controller is 
given in Figure 1 . This forms the basis of formulation of the 
discrete mathematics in subsequent sections and its physical 
implications. A similar analysis has been done in[4] to model 
the behavior of TCP-RED interaction. 

C. A discrete modeling of the system 

1) Assumptions: We make the following assumptions in 
our model. 

• There is one active connection and the connection is 
long lived that is, there is always sufficient data to send. 

• The ACK packets are never lost. 

• Round Trip propagation delay in the link and the packet 
size is constant. 

• The state variables of the system are sampled at the end 
of every RTT interval. 

• The process starts with an empty buffer 

2) Dynamical Modeling of the parameters: We first model 
the dynamics of the window size W using a discrete approx- 
imation of (|2]i for more general D2TCP case. Let Wk ,qk 
,ak and y be the window size instantaneous queue size ,the 
weighted fraction of the marked packets and the deadline of 
the flow at the end of the fc''' sampling interval. The window 
size for the next interval is determined by the queue size in 
that interval 0, it is given by: 
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if qk+i > K, 
otherwise. 



(6) 



The queue size at the sampling period ^ + 1 can be 
determined from the window size at k and the queue size 
during A;''' interval as: 
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In (|7|i , ^ gives the link capacity in packets/s. 

M . 



RTTk+i ^ d + qk- ^; gives the Round Trip Time at 
the k+l"' interval 

d- Round trip propagation delay in the link 
C-Capacity and M -Packet Size. 

As the buffer is limited by its size B. And a negative queue 
size has no meaning, we can set realistic bounds on qk+i as. 



qk+i ^ min{max{Wk -^,Q),B) 



(8) 



^The window size calculated at the i''' interval determines how many 
packets to schedule for transfer in the next interval so the window size in 
the i''' interval participates in the queue generation in the k+l'^' interval 



The probabilistic bursty marking scheme at the switch re- 
mains (|5]l. 

The congestion history parameter is updated every RTT as. 



ock+i ^il-8)-cCk + g-pk+i 
Or altematively,using (|5]l. 
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if qk+i > K, 
otherwise. 



(9) 
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D. The Map 

In this model as the instantaneous queue size is taken into 
consideration for the marking of packets so, the queue build 
up has no memory and depends only on the window size 
of the previous instant. Thus, the queue size qk is not an 
independent parameter The independent parameters are the 
congestion history (a<.) and the window size (Wk)- 
Substituting (|7]i in (|6]l we have. 



Wk 
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{l-^)-Wk if Wk^^>K, ^jj^ 



Wi + 1 otherwise, 
and substituting (O in ( fTol i we have. 



«A:+1 = 



{l-g)-ak + g if Wk-^>K, 



(l-^)-«^ 



otherwise. 



(12) 



thus (l7]). (fTTl i.(fT2li give the map form that can be used to 
model the dynamics of the system. 

E. Mathematical analysis of phase space and the borders. 

The map of W has two distinct regions of operation sepa- 
rated by a border qk+ \ = K. This border on the instantaneous 
queue size reflects on the sender side as a new border: 
Wk = K* where K* — ^+ K.ln The additive increase phase 
where if the Wj. is less than a threshold value K* implying, 
qk+\ < K the definition of the map in (fTTT l says that the 
window size slowly increases and this additive increase is 
independant of a. As a result of the additive increase, the 
window size after a certain time hits the threshold {K*) and 
the map becomes discontinuous as the control mechanism 
kicks in, making the evolution of the window dependent 
on both the state variables (ak&Wk). The use of congestion 
history to determine the next window size when congestion is 
detected is the key feature of DCTCRthus a high Uk implies 
a higher cut in the window size in the next stage and vice 
versa. These features of the evolution of the window size are 
demonstrated graphically in Fig. 2 & Fig. 3. 

The evolution of a also follows a similar algorithm with 
borders playing the role for the discontinuity induced. The 
Congestion history for the next step is determined using the 
knowledge of the queue size in the current step. As long as 
the system senses congestion i. e qk+i > K the congestion 
history successively increases, simultaneously window size 
multiplicatively decreases until it hits the border K* from 
the right side. When the Wk becomes less than K* i. e 
there is 'no congestion' feedback,a successively decreases 
and correspondingly window size goes into the additive 



increase phase until congestion arises again,i. e this time the 
congestion window hits the border K* from the left. 

Thus, the congestion control system operates by succes- 
sively switching between two subsystems as a result of the 
system states colliding with border values. This in turn leads 
to chaotic dynamics through border collision bifurcation as 
we will demonstrate later 

The first and the second return maps for a are given in 
Fig. 4 for the evolution of qi,+i = 35 through successive 
iterations, for generating the maps we use, 7= l,d = 
30^i,C = lOGbps,g = 1 /16,K = ISpackets, M = 1Kb 




Fig. 2. Figure showing the 1^' return map of W at different congestion levels when 
K=15 




Fig. 3. Figure showing the 1" and 2'"' return map of Wi- — 71.62((ji+i — 35) at 
different congestion levels when K=15 




Fig. 4. Figure showing the V and 2'"^ return map of a when — l\.62[q^^\ — 35) 
when K=15 

VI. Numerical Analysis 

The behavior of the map can be explored in parameter 
space numerically,in order to find interesting dynamical 
phenomena. 

A whole range of dynamical scenarios are presented in this 
section. The effect of the changes on the system described by 
piecewise smooth discontinuous maps are reflected through 
bifurcation diagrams. 



A. Bifurcation diagrams 

When the future state of a dynamical variable is dependent 
on a particular parameter(s) then variation in the parame- 
ter(s) would result in change in the dynamical behavior of 
the system on a whole. A bifurcation diagram shows the 
qualitative changes in the nature or the number of steady state 
solutions of the dynamical system as a parameter varies. On 
the horizontal axis we plot the parameter value. The vertical 
axis displays a measure of the corresponding fixed points or 
periodic orbit^ which coincides with the queue build up in 
the present context. 

The way to read a bifurcation diagram is to fix a point in 
the horizontal axis and draw a vertical line through it. The 
number of points where the bifurcation curve intersects the 
vertical line gives us the number of equilibrium points in that 
given configuration. A single point implies there is a stable 
fixed point and multiple points imply a periodic long-term 
behavior of the system. 

We investigate the dynamical behavior of the instantaneous 
queue size in a DCTCP (D2TCP) system with a single 
connection when the parameters like Marked fraction weight 
(g),the round trip propagation delay (c/),deadline(7) and the 
marking threshold (K) are varied. We draw the bifurcation 
diagram by plotting the successive maxima and minima of 
the instantaneous queue siz^in packets) against a parameter 
setup. Other system parameters are kept fixed at: 

C = lOGbps;M = lKb;B = IQQpackets. 

B. Bifurcation parameter : Marked fraction weight (g) 

We present the bifurcation diagram with g as the bifurca- 
tion parameter which varies from 0. 001 to 0. 1 through a 
step size of 0. 0001 ,and other parameters are given as. 
Case 1: 

When 7=1 ; d ^ Ins ; K=20 in Fig. 5 
Case 2: 

When 7=1 ; d ^ lOO^s ; K=20 in Fig. 6 

In the bifurcation diagram for parameter setup in case 1 . 
As the Round Trip Delay is very small so the packet marks 
are fed-back faster so we should expect stable dynamical 
behaviour The bifurcation diagram of the system has a wide 
range of g for which stable periodic solutions exist which 
is shown by the region of the diagram which has a finite 
number of fixed points. Like the region having 6 fixed points 
correspond to a stable period-3 orbit in the time series plot 
of the queue size. But for a range of g we have bounded but 
locally unstable range of fixed points, that generates a band 
like structure in the diagram for the corresponding ranges. 

In case 2. The delay is made larger so the feedback system 
is slow. This gives rises to more complicated dynamics. The 
periodic windows disappear, the amplitude of oscillations 
increase and ranges of g for chaotic oscillation increases. 
This complication in behaviour as the delay is increased is 
consistent with the results in [5] [6]. 

'Mathematically speaking, topological invariants 

''Transient responses are eliminated by long time evaluation of the system 
states. Steady state solutions ought to be used 
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Fig. 5. The bifurcation diagram with g as the bifurcation parameter and d — Itis 
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Fig. 6. The bifurcation diagram with g as the bifurcation parameter and d — lOO^j 

C. Bifurcation parameter : Round trip delay (d) 

The Round trip delay(d) is the parameter which varies 
quite a lot in practical networking scenarios. We draw the 
bifurcation diagram (Fig. 7) for delay varying from the range 
of Ins to lOOfis. Other parameters set up as: 
K^20;y= = 0.037. 

Here in this case we see stable operation of the system 
when the delay is small and it generates complicated dy- 
namical behavior when the delay increases. When the delay 
is large, the queue dynamics locks on several periodic attrac- 
tors interleaved with ranges where cascades of bifurcations 
leading to higher periodic solutions may be detected. 

D. Bifurcation parameter : Marking Threshold (K) 

We present the bifurcation diagram with K as the bifurca- 
tion parameter(Fig. 8) which varies from 5 to 25 through a 
step size of 0.01 ,and other parameters are given as. 
d = Iij.s;y= l;g = 1/16. 

In this case we see similar behavior in the bifurcation 
diagram i. e the system alternating between stable periodic 
orbits and then locking on to high periodic orbits through 
period adding cascades as K is varied. 

E. Bifurcations in the congestion history variable (a) 

We draw the bifurcation diagram of with respect to the 
marked fraction weight (g) other parameters set as 7 — 1 and 
d ~ lOOjUi (Fig. 9). g varies from 0.001 to 0.2 through a step 
size of 0.0001. We see a novel type of bifurcation diagram 
which has a chaotic regime at low values of g and shows high 
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Fig. 7. The bifurcation diagram with d{inseconds) as the bifurcation parameter 
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Fig. 8. The bifurcation diagram with K as the bifurcation parameter 
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Fig. 9. The bifurcation diagram of a with g as the bifurcation parameter and A" — 20 

periodic orbits of a and larger amplitude of oscillation at 
higher values of g. This result is consistent with the relation 
defined in The bifurcation diagram changes form as other 
parameters like delay(c/) ,(7) etc. are varied. 

F. Time series plots and cobweb diagrams 

Here we show the actual time series evolution of the state 
variables for two different cases. One for a stable periodic 
regime and other for a chaotic regime. We also demonstrate 
the congestion control mechanism through cobweb diagrams 
of the evolution of the window size. 

case 1: We take d — 30«i,7= \,g — 0.037. The state space 
plots are given in Fig. 10 . As per the bifurcation diagrams 
the time series plots show a period 3 oscillatory behavior for 
all the variables. 

case 2: We take d — iQns.y— l,g — 0.042. The state space 



plots are given in Fig. 12. 

The cobweb diagram is widely employed to study the qual- 
itative behavior of a map and it is possible to infer the long 
term status of an initial condition under repeated application 
of a map using it. A cobweb diagram demonstrates graphi- 
cally the successive mappings of the chosen state variable, 
in our case Wit. To plot the cobweb diagram we evolve the 
dynamical system starting from arbitrary initial condition and 
a given parameter setup long enough for it (if at all) to reach 
steady state behavior Taking, the last n points of the steady 
state response of the chosen variable (W^.), the successive 
mappings can be graphically shown by iteratively joining 
the pomts(Wk,Wk+i),(Wk+uWk+i),(W,,+uWk+2), where 
1,2, . . . , (n — 2). The number of lobes in the cobweb diagram 
communicates the period of steady state oscillation. The 
cobweb diagram for case:l is given in Fig. 11. It shows 
3 lobes thus implying a steady state period 3 behavior under 
the given circumstances. The cobweb diagram foxcase:2 is 
given in Fig. 13. It shows multiple lobes thus implying a 
very high periodicity and even possibly chaotic dynamics of 
the evolution of the window size. 

VII. Generic nature of dynamical behavior and 

CONCLUSION 

Nonlinear phenomena has been observed before in com- 
puter and telecommunication networks and our current work 
shows that even the most advanced next generation network 
protocols continue to display fully developed chaos which is 
in stark contrast with claims of global stable multi-frequency 
limit cycle behavior of the DCTCP system [7]. To make 
it mathematically precise, almost all network protocols like 
TCP and their dynamics can be understood in terms of 
the iterations of the two-dimensional, piecewise nonlinear, 
discontinuous map which is formulated, analyzed and sim- 
ulated in this work. The nature of the bifurcations reported 
here has a resemblance to the corner bifurcations reported 
in [8] which is observed in impact oscillators and it also 
shows similarity with chaotic behavior observed earlier in 
current controlled boost converters [9]. Future work involves 
demonstrating the DTCP chaos in dynamics[10]/ns-3[l 1], 
in hardware and development of a new class of protocols 
for rock-stable and super-efficient operation over wildly 
fluctuating parameter regions. 
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Fig. 12. The time series plots for case:2 
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Fig. 13. Cobweb diagram for the evolution of W when g = 0.042 showing 
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